Gap filling and noise reduction of unevenly sampled data by means of the Lomb - Scargle periodogram
نویسنده
چکیده
The Lomb-Scargle periodogram is widely used for the estimation of the power spectral density of unevenly sampled data. A small extension of the algorithm of the Lomb-Scargle periodogram permits the estimation of the phases of the spectral components. The amplitude and phase information is sufficient for the construction of a complex Fourier spectrum. The inverse Fourier transform can be applied to this Fourier spectrum and provides an evenly sampled series (Scargle, 1989). We are testing the proposed reconstruction method by means of artificial time series and real observations of mesospheric ozone, having data gaps and noise. For data gap filling and noise reduction, it is necessary to modify the Fourier spectrum before the inverse Fourier transform is done. The modification can be easily performed by selection of the relevant spectral components which are above a given confidence limit or within a certain frequency range. Examples with time series of lower mesospheric ozone show that the reconstruction method can reproduce steep ozone gradients around sunrise and sunset and superposed planetary wave-like oscillations observed by a ground-based microwave radiometer at Payerne. The importance of gap filling methods for climate change studies is demonstrated by means of long-term series of temperature and water vapor pressure at the Jungfraujoch station where data gaps from another instrument have been inserted before the linear trend is calculated. The results are encouraging but the present reconstruction algorithm is far away from being reliable and robust enough for a serious application.
منابع مشابه
Gap filling and noise reduction
Gap filling and noise reduction of unevenly sampled data by means of the Lomb-Scargle periodogram K. Hocke and N. Kämpfer Institute of Applied Physics, University of Bern, Switzerland Received: 25 January 2008 – Accepted: 4 February 2008 – Published: 4 March 2008 Correspondence to: K. Hocke ([email protected]) Published by Copernicus Publications on behalf of the European Geoscience...
متن کاملDetecting periodic patterns in unevenly spaced gene expression time series using Lomb-Scargle periodograms
MOTIVATION Periodic patterns in time series resulting from biological experiments are of great interest. The commonly used Fast Fourier Transform (FFT) algorithm is applicable only when data are evenly spaced and when no values are missing, which is not always the case in high-throughput measurements. The choice of statistic to evaluate the significance of the periodic patterns for unevenly spa...
متن کاملFrequency Estimation Based on the Cumulated Lomb-scargle Periodogram
We consider the problem of estimating the period of an unknown periodic function observed in additive Gaussian noise sampled at irregularly spaced time instants in a semiparametric setting. To solve this problem, we propose a novel estimator based on the cumulated Lomb-Scargle periodogram. We prove that this estimator is consistent, asymptotically Gaussian and we provide an explicit expression ...
متن کاملFrequency Estimation And Generalized Lomb-Scargle Periodograms
Using Bayesian probability theory we demonstrate that the Lomb-Scargle periodogram may be generalized in a straightforward manner to nonuniformly nonsimultaneously sampled quadrature data when the sinusoid has arbitrary amplitude modulation. This generalized Lomb-Scargle periodogram is the sufficient statistic for single frequency estimation in a wide class of problems ranging from stationary f...
متن کاملSearching for biological rhythms: peak detection in the periodogram of unequally spaced data.
The classical power spectrum, computed in the frequency domain, outranks traditionally used periodograms derived in the time domain (such as the chi2 periodogram) regarding the search for biological rhythms. Unfortunately, classical power spectral analysis is not possible with unequally spaced data (e.g., time series with missing data). The Lomb-Scargle periodogram fixes this shortcoming. Howev...
متن کامل